# Multi-bit quantization

Dia GGUF
MIT
Dia 1.6B is a model suitable for text-to-speech tasks, supporting multiple quantized versions and compatible with the TTS.cpp framework.
Speech Synthesis
D
mmwillet2
156
4
Qwen3 30B A3B GGUF
The GGUF quantized version of Qwen3-30B-A3B, supporting multi-bit quantization, suitable for text generation tasks.
Large Language Model
Q
MaziyarPanahi
158.92k
3
Qwen3 0.6B GGUF
GGUF quantized version of Qwen3-0.6B, suitable for text generation tasks.
Large Language Model
Q
MaziyarPanahi
233.95k
2
Mistral Small 3.1 24b Instruct 2503 Hf GGUF
This is a GGUF format quantized version of the mrfakename/mistral-small-3.1-24b-instruct-2503-hf model, suitable for text generation tasks.
Large Language Model
M
MaziyarPanahi
137.78k
2
Llama 3.1 8B RainbowLight EtherealMix GGUF
This is a quantized version in GGUF format based on the Llama-3.1-8B-RainbowLight-EtherealMix model, which facilitates the development of applications related to text generation.
Large Language Model
L
MaziyarPanahi
101
1
Llama 3.2 3B Instruct GGUF
The GGUF format file of the Llama-3.2-3B-Instruct model, which is convenient for users to perform text generation tasks.
Large Language Model
L
MaziyarPanahi
203.56k
13
Llama 3 Smaug 8B GGUF
GGUF format quantized model based on abacusai/Llama-3-Smaug-8B, supporting 2-8 bit quantization levels, suitable for text generation tasks
Large Language Model
L
MaziyarPanahi
8,904
5
Phi 2 Super GGUF
MIT
phi-2-super-GGUF is the GGUF quantized version of the abacaj/phi-2-super model, suitable for local execution and text generation tasks.
Large Language Model Transformers
P
MaziyarPanahi
158
5
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase